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Technology (IDCTT) Trainer. This device — the product of a four year advanced development effort — 
uses interactive courseware which incorporates the latest multi-media computer technology to create a 
i realistic damage control training environment. The trainer was developed to support a recent change in 
| shipboard damage control philosophy called Total Ship Survivability (TSS); a concept which emphasizes 
! the simultaneous repairing of a ship’s combat damage while maintaining its ability to fight. 

The new trainer was comprehensively evaluated using performance data and survey results collected 
from students and instructors during a three month test period at the Surface Warfare Officer School’s 
Damage Control School in Newport, R.l. Findings from seven different surveys are presented; performance 
comparisons between the conventional trainer and this new trainer are examined; and narrative accounts of 
both students and instructors are reported. The data clearly identify and isolate the specific benefits as well 
as some drawbacks associated with the various enabling technologies integrated during the advanced 
development of the prototype. Recommendations about operationally deploying the device are discussed and 
die implications ul suggested enhancements are explored. 
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abstract 



This paper reports the test and evaluation results of the Integrated Damage 
Control Training Technology (IDCTT) Trainer. This device — the product of a 
four year advanced development effort — uses interactive courseware which 
incorporates the latest multi-media computer technology to create a realistic damage 
control training environment. The trainer was developed to support a recent 
change in shipboard damage control philosophy called Total Ship Survivability 
(TSS); a concept which emphasizes the simultaneous repairing of a ship’s combat 
damage while maintaining its ability to fight. 

The new trainer was comprehensively evaluated using performance data and 
survey results collected from students and instructors during a three month test 
period at the Surface Warfare Officer School’s Damage Control School in Newport, 
R.I. Findings from seven different surveys are presented; performance comparisons 
between the conventional trainer and this new trainer are examined; and narrative 
accounts of both students and instructors are reported. The data clearly identify 
and isolate the specific benefits as well as some drawbacks associated with the 
various enabling technologies integrated during the advanced development of the 
prototype. Recommendations about operationally deploying the device are discussed 
and the implications of suggested enhancements are explored. 
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EXECUTIVE SUMMARY 



Recent developments in multimedia technology have made it possible for 
computer generated simulations to create vivid, life-like damage control training 
scenarios. The Navy's damage control community — acquisition agents, trainers, 
and research and development managers — has explored these new technologies to 
produce more realistic training scenarios. One such exploration culminated in 
a multimedia integration of several enabling technologies collectively called 
IDCTT : the Integrated Damage Control Training Technology. 

The Integrated Damage Control Training Technology (IDCTT) Trainer is an 
interactive video courseware (ICW) medium which incorporates the latest video and 
audio technology to provide realistic damage control training in a simulated 
shipboard environment. IDCTT' s design goal was to provide Damage Control 
Assistants (DCAs) with interactive computer-based damage control scenarios that 
realistically showed the consequences of their damage control decisions in terms 
of their impact on the shipboard environment. This thesis evaluated the extent 
to which this interactive video courseware achieved that design goal. 
Specif ical ly , it validated the effectiveness of the IDCTT Trainer as a training 
tool for Damage Control Assistants (DCAs) and the instructors who train them. 

IDCTT was specifically designed to support DCA training, not in the 
conventional sense, but under relatively recent changes in shipboard damage 
control philosophy. The results of this doctrinal shift has been called the 
Total Ship Survivability (TSS) concept . Total Ship Survivability reasserts the 
World War II concept of simultaneously repairing combat damage while maintaining 
the ship's ability to fight. TSS is a training concept designed to increase a 
ship's war fighting capability and the IDCTT Trainer, in turn, ' is designed to 
deliver that TSS based training concept. 

This paper examined two central aspects of the IDCTT Trainer's performance: 
its performance in and of itself, and its performance when compared to the 
trainer currently in use, which is called the Damage Control Central Trainer. 
Pinpointing these relatively circumscribed areas enabled the evaluation and the 
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subsequent analyses to produce sufficient data needed to quantify the impact the 
new integrated technologies had upon both student and instructor performance. 

The test and evaluation data collection plan for the device was designed 
to solicit and collect student and instructor inputs, which taken together, 
provided a basis upon which to evaluate how well IDCTT supported DCA training. 
This portion of the study identified system strengths, weaknesses, and design 
features of the prototype which could be improved to enhance its next variant 
and subsequent generations of the product. Also, the measures of student and 
instructor reactions to IDCTT provided a basis from which to gain insights into 
the usefulness of the trainer as a fleet training aid. Students and instructors 
provided this information using short essays and descriptive narrative accounts, 
quantitative subjective rating data, check-off lists of problem features, formal 
surveys, and both structured and unstructured interviews. 

A direct comparison of IDCTT with the DC Central Trainer was done to 
concurrently determine the relative effectiveness of both trainers. The 
evaluation sought to draw comparisons by obtaining student performance scores for 
each trainer type on a variety of comparative dimensions, and on measures of each 
systems' ability to produce standardized training scenarios. This information 
was obtained during student training sessions conducted in both trainers during 
which performance was carefully graded using a standardized grading protocol. 
Moreover, subjective impressions of user preferences were quantified using 
standardized rating scales designed to further compare and contrast design 
features of both trainers . 

IDCTT 's test and evaluation was conducted at the Damage Control Training 
Department of the Surface Warfare Officer School in Newport, Rhode Island. This 
school provides the only academic training for novice DCAs . Before this study, 
the School's only source of simulated DCA battle problem training was the 
conventional Damage Control Central Trainer. The new IDCTT Trainer was 
transported to the DCA School and installed in its simulation wing for the 
purpose of the current test and evaluation study. 

Data were collected on three occasions. The first test period, 24 through 
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29 March 1994, consisted of preliminary trials designed to validate the planned 
data collection methodology and to evaluate the IDCTT Trainer's performance 
characterist ics . Findings from this pilot test phase were used to modify the 
original test and evaluation data collection plan as well as the actual hardware 
configuration of the IDCTT trainer prototype itself. The validation data were 
collected during the second and third test periods which were conducted 19 
through 21 April 1994, and 20 through 22 June 1994. Thirty-two students and 
seven instructors participated in the evaluation. 

The validation data revealed that the IDCTT Trainer was highly effective 
on the majority of training dimensions specifically evaluated by the test 
methodology. For example, students reported that the IDCTT Trainer was easy to 
operate and extremely useful as a training aid at the Damage Control School. 
They also reported their desire to see the trainer made available for shipboard 
use. When the IDCTT Trainer was directly compared to the DC Central Trainer, 
students reported that the IDCTT Trainer was clearly the preferred training 
method. IDCTT promoted a more rapid acquisition of basic skills and ultimately, 
a higher level of proficiency. Moreover, contrasted to the conventional DC 
Central Trainer, IDCTT induced significantly higher levels of stress and 
motivated students to more actively participate in the damage control scenario. 
Formal statistical tests of the differences between scores from the two different 
trainers revealed that the IDCTT scores were in fact higher than the conventional 
DC Trainer's (p < .05). 

Although students and instructors reported that the IDCTT Trainer was an 
effective training medium, they did identify configural and functional 
characteristics of the trainer for potential improvement. For example, some of 
these candidate changes were associated with using the touchscreen monitor to 
input information into the system. Fifty-nine percent of the students reported 
that they experienced some difficulty operating this input device. The screen's 
primary problem was its low sensitivity to touch and its slow response time. 
Students recommended increasing its sensitivity or simply exploring different 
input methods, such as voice activation for future consideration. The 
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touchscreen design feature was but one of several identified by this evaluation. 
The present report lists other suggested modifications to the system and offers 
substantiation to support the need for reconfiguration in future variants. 

The collective reports from both student officers and instructors who used 
IDCTT ' s technologies revealed one broad, simple finding: the trainer was as well 
liked by its users as it was effective, especially when compared to its 
conventional counterpart. As good as IDCTT was however, students and instructors 
freely suggested ways to make it better. The findings and recommendations 
contained in this report, therefore, highlight the indispensable role formal 
test and evaluation methodologies play in the transition of educational products 
from advanced development to service use. 
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I . INTRODUCTION 



Throughout American Naval History, damage control has played a key 
role in the success of American warships at sea. The fundamental 
requirement needed to prepare for battle damage is damage control training 
and since it is unreasonable for ships to actually incur self-imposed 
damage, damage control training has come to employ simulations of battle 
damage situations. In the past, these scenarios were relatively crude, 
relying heavily upon human intensive role playing. Recent developments in 
multimedia capabilities however have made it possible for computer 
generated simulations to create life-like training scenarios. The damage 
control community has adopted these new technologies to produce more 
realistic training scenarios. One such adaptation is a multimedia package 
called the Integrated Damage Control Training Technology (IDCTT). 

The Integrated Damage Control Training Technology (IDCTT) Trainer is 
an interactive video courseware (ICW) medium which incorporates the latest 
video and audio technology to provide damage control training in a 
simulated shipboard environment. This thesis addresses that interactive 
video courseware. Specif ically , it validates the effectiveness of IDCTT 
as a training tool for Damage Control Assistants (DCAs) and its results 
will be used by the Naval Personnel Research and Development Center 
(NPRDC) to justify the use of the IDCTT system as a fleet training aid. 

The focus of the present chapter is threefold. First, background 
information concerning the IDCTT Trainer and the fundamental concepts of 
damage control are discussed. Second, a detailed description of the new 
multimedia components used to create the Interactive Damage Control 
Training Technologies (IDCTT) Trainer is provided. A description of the 
user's interaction in this new medium is included in the discussion. 
Finally, the conventional shore based training technique in use today, the 
Damage Control Central Trainer, is summarized. 
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A, BACKGROUND 

IDCTT was specifically designed to support DCA training, not in the 
conventional sense, but under a relatively recent change in shipboard 
damage control philosophy called the Total Ship Survivability (TSS) 
concept. Total Ship Survivability employs the World War II concept of 
simultaneously repairing combat damage while maintaining the ship's 
ability to fight. After the USS Stark (1987) and USS Samuel B. Roberts 
(1988) incidents, it became apparent that the damage control organization 
was able to repair damage necessary to save the ship but in each incident, 
the ship lost the ability to defend itself from further attacks. TSS is 
a training concept designed to increase a ship's war fighting capability 
and the IDCTT Trainer is designed to deliver that TSS based training 
concept . 

The IDCTT Trainer uses information from the Battle Damage Estimator 
(BDE) which is a software package that displays the most probable damage 
to a ship after being hit with a particular weapon. Moreover, IDCTT 
interfaces with the Integrated Survivability Management System (ISMS), 1 
which provides two dimensional graphic representations of the ship, to 
produce line diagram drawings of damaged areas and systems. 2 It also uses 
the latest laser disk video, compact disk audio, and computer technology 

to create a realistic training environment. 

1. Damage Control Fundamentals 

A basic understanding of what Naval Damage Control is and how it 
is conducted is needed to understand what IDCTT attempts to accomplish. 
Damage Control is divided into two disciplines; damage prevention, and 
damage containment and repairs. The IDCTT Trainer focuses on damage 



1 The ISMS system was removed from the IDCTT Trainer after initial test 
results revealed human interface problems which will be discussed later in the 
text . 



The Battle Damage Estimator (BDE) and the Integrated Survivability 
Management System (ISMS) will be described in detail later in the text. 



